Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.

More right-solid
More right-solid
More right-solid
More right-solid
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
139,442
ITEMS
1.3B
VIEWS
collection
eye 1.3B
A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
100,905
ITEMS
495.5M
VIEWS
collection
eye 495.5M
A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00500
collection
2,019
ITEMS
50.5M
VIEWS
by Internet Archive
collection
eye 50.5M
top_domains-00900
collection
3,681
ITEMS
39.8M
VIEWS
by Internet Archive
collection
eye 39.8M
top_domains-00600
collection
5,276
ITEMS
38.2M
VIEWS
by Internet Archive
collection
eye 38.2M
top_domains-00250
collection
1,733
ITEMS
33.6M
VIEWS
by Internet Archive
collection
eye 33.6M
top_domains-00300
collection
3,741
ITEMS
33.5M
VIEWS
by Internet Archive
collection
eye 33.5M
top_domains-00800
collection
5,669
ITEMS
31.9M
VIEWS
by Internet Archive
collection
eye 31.9M
top_domains-00350
collection
1,840
ITEMS
30.4M
VIEWS
by Internet Archive
collection
eye 30.4M
top_domains-02250
collection
1,964
ITEMS
28.8M
VIEWS
by Internet Archive
collection
eye 28.8M
top_domains-00700
collection
1,378
ITEMS
27.4M
VIEWS
by Internet Archive
collection
eye 27.4M
top_domains-01500
collection
2,427
ITEMS
25.9M
VIEWS
by Internet Archive
collection
eye 25.9M
top_domains-00400
collection
1,280
ITEMS
25.7M
VIEWS
by Internet Archive
collection
eye 25.7M
top_domains-00450
collection
2,429
ITEMS
24M
VIEWS
by Internet Archive
collection
eye 24M
top_domains-02750
collection
1,477
ITEMS
23.6M
VIEWS
by Internet Archive
collection
eye 23.6M
top_domains-02500
collection
2,384
ITEMS
22.1M
VIEWS
by Internet Archive
collection
eye 22.1M
worldpress.org
collection
446
ITEMS
21.6M
VIEWS
by http://worldpress.org/
collection
eye 21.6M
top_domains-07500
collection
1,534
ITEMS
21.4M
VIEWS
by Internet Archive
collection
eye 21.4M
top_domains-02000
collection
1,595
ITEMS
20.7M
VIEWS
by Internet Archive
collection
eye 20.7M
yahoo.com
collection
864
ITEMS
20.5M
VIEWS
collection
eye 20.5M
top_domains-01000
collection
2,008
ITEMS
20.3M
VIEWS
by Internet Archive
collection
eye 20.3M
top_domains-09500
collection
3,467
ITEMS
19.3M
VIEWS
by Internet Archive
collection
eye 19.3M
vkontakte.ru
collection
319
ITEMS
18.2M
VIEWS
by http://vkontakte.ru
collection
eye 18.2M
top_domains-04250
collection
1,694
ITEMS
16.4M
VIEWS
by Internet Archive
collection
eye 16.4M
top_domains-04500
collection
1,455
ITEMS
16.3M
VIEWS
by Internet Archive
collection
eye 16.3M
time.com
collection
448
ITEMS
16.1M
VIEWS
by http://time.com
collection
eye 16.1M
top_domains-04000
collection
2,031
ITEMS
16.1M
VIEWS
by Internet Archive
collection
eye 16.1M
top_domains-08750
collection
1,661
ITEMS
15.7M
VIEWS
by Internet Archive
collection
eye 15.7M
stumbleupon.com
collection
170
ITEMS
15.6M
VIEWS
by http://stumbleupon.com
collection
eye 15.6M
top_domains-03000
collection
1,333
ITEMS
15.4M
VIEWS
by Internet Archive
collection
eye 15.4M
top_domains-06000
collection
2,675
ITEMS
15.4M
VIEWS
by Internet Archive
collection
eye 15.4M
top_domains-01750
collection
962
ITEMS
14.9M
VIEWS
by Internet Archive
collection
eye 14.9M
top_domains-08000
collection
1,120
ITEMS
14.8M
VIEWS
by Internet Archive
collection
eye 14.8M
huffingtonpost.com
collection
1,827
ITEMS
14.7M
VIEWS
by http://huffingtonpost.com
collection
eye 14.7M
top_domains-05250
collection
2,395
ITEMS
14.6M
VIEWS
by Internet Archive
collection
eye 14.6M
top_domains-09000
collection
2,631
ITEMS
14.4M
VIEWS
by Internet Archive
collection
eye 14.4M
top_domains-07000
collection
1,841
ITEMS
14.2M
VIEWS
by Internet Archive
collection
eye 14.2M
themeforest.net
collection
334
ITEMS
14.2M
VIEWS
by themeforest.net
collection
eye 14.2M
top_domains-06750
collection
2,785
ITEMS
14.1M
VIEWS
by Internet Archive
collection
eye 14.1M
top_domains-06250
collection
1,028
ITEMS
13.8M
VIEWS
by Internet Archive
collection
eye 13.8M
top_domains-04750
collection
858
ITEMS
13.4M
VIEWS
by Internet Archive
collection
eye 13.4M
top_domains-05500
collection
5,966
ITEMS
12.9M
VIEWS
by Internet Archive
collection
eye 12.9M
tumblr.com
collection
447
ITEMS
12.7M
VIEWS
by http://tumblr.com
collection
eye 12.7M
top_domains-00500
web
eye 12.3M
favorite 0
comment 0
Source: top_domains-00500
top_domains-03500
collection
1,244
ITEMS
12.2M
VIEWS
by Internet Archive
collection
eye 12.2M
top_domains-03750
collection
1,576
ITEMS
12.2M
VIEWS
by Internet Archive
collection
eye 12.2M
top_domains-06500
collection
1,528
ITEMS
12.1M
VIEWS
by Internet Archive
collection
eye 12.1M
neobux.com
collection
31
ITEMS
12.1M
VIEWS
by neobux.com
collection
eye 12.1M
nbcnews.com
collection
621
ITEMS
11.8M
VIEWS
by nbcnews.com
collection
eye 11.8M
taringa.net
collection
773
ITEMS
11.7M
VIEWS
by taringa.net
collection
eye 11.7M
current.com
collection
325
ITEMS
11.6M
VIEWS
by http://current.com/
collection
eye 11.6M
top_domains-08250
collection
2,710
ITEMS
11.5M
VIEWS
by Internet Archive
collection
eye 11.5M
pinterest.com
collection
179
ITEMS
11.3M
VIEWS
by pinterest.com
collection
eye 11.3M
top_domains-01250
collection
647
ITEMS
10.9M
VIEWS
by Internet Archive
collection
eye 10.9M
top_domains-08500
collection
747
ITEMS
10.8M
VIEWS
by Internet Archive
collection
eye 10.8M
nytimes.com
collection
682
ITEMS
10.8M
VIEWS
by http://nytimes.com
collection
eye 10.8M
latimes.com
collection
468
ITEMS
10.7M
VIEWS
by http://latimes.com
collection
eye 10.7M
neobux.com
web
eye 10.6M
favorite 0
comment 0
Source: neobux.com
edgi monitor
collection
788
ITEMS
10.5M
VIEWS
collection
eye 10.5M
top_domains-03250
collection
732
ITEMS
10.2M
VIEWS
by Internet Archive
collection
eye 10.2M
sfgate.com
collection
3,248
ITEMS
10.1M
VIEWS
by http://sfgate.com
collection
eye 10.1M
top_domains-05000
collection
799
ITEMS
9.9M
VIEWS
by Internet Archive
collection
eye 9.9M
top_domains-05750
collection
910
ITEMS
9.9M
VIEWS
by Internet Archive
collection
eye 9.9M
chicagotribune.com
collection
359
ITEMS
9.7M
VIEWS
by http://chicagotribune.com/
collection
eye 9.7M
top_domains-09750
collection
1,225
ITEMS
9.4M
VIEWS
by Internet Archive
collection
eye 9.4M
inn.co.il
collection
441
ITEMS
9.3M
VIEWS
by http://inn.co.il/
collection
eye 9.3M
newser.com
collection
168
ITEMS
9.3M
VIEWS
by http://newser.com/
collection
eye 9.3M
buzzfeed.com
collection
1,455
ITEMS
9.2M
VIEWS
by buzzfeed.com
collection
eye 9.2M
top_domains-07250
collection
1,644
ITEMS
9M
VIEWS
by Internet Archive
collection
eye 9M
top_domains-07750
collection
750
ITEMS
9M
VIEWS
by Internet Archive
collection
eye 9M
foxnews.com
collection
795
ITEMS
8.9M
VIEWS
by http://foxnews.com
collection
eye 8.9M
xvideos.com
collection
1,465
ITEMS
8.9M
VIEWS
by http://xvideos.com
collection
eye 8.9M
top_domains-09250
collection
851
ITEMS
8.9M
VIEWS
by Internet Archive
collection
eye 8.9M
guardian.co.uk
collection
847
ITEMS
8.7M
VIEWS
by http://guardian.co.uk/
collection
eye 8.7M
wordpress.org
collection
958
ITEMS
8.2M
VIEWS
by http://wordpress.org
collection
eye 8.2M